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CHAPTER 1 


1.1 Introduction 

Microbial biochemical reactions in absence of air are calle 
fermentation reactions . These reactions are generally anaerobi< 
in nature. The examples of fermentation include the industrial 
scale manufacture of glutamate, lysine, threonine, valine, 
glutamine, aspartic acid, anthranine and other amino acids. 

Three major challanges associated with such systems involves 
modelling, optimisation and control. The challenges involved in 
modelling is to come up with suitable models to predict the 
experimental data. However modelling is not trivial as most 
reactions have unknown kinetics . Emperical relationship such as 
Monod, Blackman hole model, Heldane have been used from time to 
time to predict the experimental behaviour such as decay of 
substrate with time, growth of cell with time etc. 

Optimisation problems are associated with maximising the cell 
concentration or the product formation along with the subsrrate or 
product inhibition. Various feeding stratagey have been used to 
find the optimum of the same. Nonlinear programming techniques 
like SQP or Pontrayagin' s Maximum principle are used to solved 
such problems . 

In the second chapter of this work we optimise the system 
performance of a non-repeated fed batch biochemical reactor using 
the Pontrayagin' s Maximum principle for maximising the biomass 
concentration using a nonlinear objective function without the 
constraints on the flow rate profile for the following cases. 
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(1) Fixed final volume, fixed final time, (2) Free final volume, 
fixed final time, (3) Free final volume, fixed final 
volume, (4) Free final volume, free final time. 

In the third chapter of this work we study the possible 
bifurcations diagrams of a CSTR, rapid fill repeated fed betch 
reactor and a repeated fed batch biochemical reactor filled with 


constant 

F. . 

We also 

optimise the 

system 

performance 

for 

maximising 

the 

biomass 

concentration 

for the 

following 

two 

cases . (1) 

Fixed 

final volume, fixed final time, 

(2) Free 

final 


volume, fixed final time. 

In the fourth chapter of my thesis we discuss the 
proportional control of a repeated fed- batch reactor around a 
desired but unstable periodic state .The control action is based 
on measuring the biomass concentration at the end of the cycle. 
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CHAPTER 2 


Optimisation of Non-repeated Fed-Batch Biochemical Reactors 
2.1 Introduction 

Biochemical fermentation reactions are frequently- 
characterised by substrate inhibition and/or product inhibition. 
The performance of these reactors is optimal when operated in the 
fed batch mode. Here the substrate is added to the reactor during 
the course of the reaction. The biomass is usually present 
initially in the reactor. The control variable is the substrate 
feed rate. 

The optimal performance of fermentation reactors in the fed 

batch mode has been investigated with the objective of minimising 

4 5 

either 1) the biomass production or (ii) the product formed ' . 

Two classical methods that have been used to study the problem are 
(i) Pontryagin's continuous maximum principle and (ii nonlinear 
optimisation techniques as SQP° ' . The model system most 

extensively investigated is characterised by a single reaction. 
The reaction rate varies linearly with biomass and is assumed to 
have a Haldane dependency on the substrate. 

Weigand considered the problem of maximising cell 

production in a repeated fed batch mode of operation. He obtained 
an analytical expression relating the total reaction time with 
biomass concentration under the optimal conditions. In his 
analysis however he did not assume an upper bound on the 
permissible flow rate. 

Bonte et al . and Modak determined the optimal feeding 
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profiles for different kinetic models. They developed a 

computational scheme to obtain the feeding policy which maximised 

a) pencillin production and b) cell mass production. 

The optimal control problem considered in these works is 

linear in the control variable, the substrate feed rate. It is 

hence singular in nature. The optimal policy consists of 

different portions i) when the feed rate is held at its minimum 

ii) when the feed rate is held at its maximum and iii) when the 

4 

feed rate follows a singular arc (Cazzador) . The numerical 
computation of the optimal profile however, needs a physical 
insight into the problem. This is necessary to determine the 
exact sequence of the different portions which constitute the 
optimal profile (Modak) 11 . 

In a non-biochemical engineering context optimal feed rate 

policies were obtained using pulse feeds at discrete intervals of 
8 

time by Levin . Sequential Quadratic Programming was used by 

1 10 14 

Beigler , Morrison and Sargent and Vaisliadis et al . 

13 

Shukla et al . used a sequential quadratic programming 
technique to obtain the optimum feed rate profile. They divided 
the entire interval of operation into different segments. The 
feed rate in each interval was assumed to be a constant . The 
optimal feed rate policy thus determined does not use any 
information from the physics. This approach provides a general 
mathematical basis for obtaining the optimal solution. It is 
useful when the interactions between the different variables is 
complex. The disadvantage of this technique lies in the fact that 
it is computationaly intensive. 
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In this work we propose an alternative method to investigate 
the singular optimisation problem discussed. The objective 
function is modified to include a term which is representative of 
the cost involved in prefering the optimal policy over the average 
constant flow rate. This is quadratic in the control variable. 
The problem is now nonsingular and can be analysed elegantly using 
the maximum principle. The classical singular problem 

investigated can be obtained as a limiting case of a nonsingular 
problem, by reducing the weightage assigned to the quadratic term. 
This technique can be used to provide us insight into the 
different regimes of the control variable and the sequence in 
which they occur. This information can then be used to solve the 
classical problem using the computational technique presented in 
Modak 11 . 

In this work we analyse the non-repeated fed batch mode of 
operation. We analyse four cases of reactor operation (1) fixed 
final time, fixed final volume ( 2 ) fixed final time, free final 
volume (3) free final time, fixed final volume (4) free final 
time, free final volume. We also discuss the effect of different 
initial conditions on the optimal control profiles. Throughout 
this study we assume that there are no bounds on the flow rates. 
2.2 Mathematical model 

The evolution equations which describe the reactor 

performance are : 


(VX) 

= 4 (S) XV 

2 . 1 (a) 

(VS) 

- 4 (S)XV . 

Y + FS F 

2 . 1 (b) 

(V) 

= F 

2 . 1 (c) 
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Here jn(S) represents the reaction rate dependency on the 

substrate concentration S, Y is the constant yield, S p is the 

substrate concentration in the feed, F is the flow rate of the 

substrate . 

Here we assume 


11 S 
max 


U(S) = 

aS z + £S + y 

From equations (2.1a-c) it follows that 


+ (SV) - (VS p )l = 0 


2.2 (a) 


We now obtain 

V X 

S = S„ + L2 + S - sj - 5 = g (X, V) 2.2(b) 

F V [Y o FJ Y 

Here the subscript 'o' is used to indicate the initial 
conditions in the reactor. 

This relationship is valid for all time and can be used to 
relate S(t) to X(t) . It can be used to eliminate 'S' in the 

equations 2.1(a-c). Substituting in 2.1(a-c), we can reduce the 
three dimensional system to the following two dimensional system. 

X = XjLt(g(X,V) - 2 .3 (a) 

V = F 2 . 3 (b) 


Our objective is to determine the feed-rate profile F(t) 

which maximises the biomass productivity at the terminal state. 

This gives rise to the objective function. 

Minimize J = -X^V^ 2.4(a) 

F (t ) 

This problem however, is singular since the control variable 
'F' occurs linearly in 2.3 (a, b). In this work we modify the 
objective function as 


11 


dt 


2.4 (b)- 


Minimize J = -X^V- + p f ^ (F-F) 2 
F (t ) 1 r J o 

The subscript 'f' is used to denote the final state of the 

system. The introduction of the quadratic term in 2.4(b) renders 

the problem non-singular. It can be interpreted as being 

representative of the cost involved in maintaining the optimal 

profile F(t) instead of the average profile F. It is hence 

- 2 

proportional to the deviation (F - F) . The scalar p is a 
weightage factor which can be used to change the importance of the 
two terms . 

The optimal control problem can be solved elegantly by using 
Pontryagin' s Maximum Principle. We define the Hamiltonian 

+ A v F + p (F-F) 2 (2.5) 

Here A. and A are the adjoint variables associated with 
xv J 

2.3 (a, b). Their evolution is governed by 


H = A 


x 


XjU (g (X, V) ) 


FX 

V 


X = -X 
x x 


U (g (X, V) + X ° 4(g gx /V)) " | 


2.6(a) 


X 


au(g(X,V) ) ^ FX' 


av 


v 2 -“ 


2.6(b) 


The optimal flow rate profile is obtained by setting 


H p = 0 


This gives 


(2 - 7) 

In this work we analyse the optimum profile for the four 
different cases mentioned earlier . For each of the cases the 
equations 2.3 (a,b), 2.4b, 2.6 (a, b) have to be solved such that 
they satisfy certain conditions. 
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Case I: Fixed final volume, fixed final time - The optimum profile 
is obtained when the following conditions are satisfied. 

X x (t f } + v f = 0 

or F^ = 0 

V (t f ) - V f = 0 (2.8) 


Case II: Fixed final time, free final volume 
now satisfies 


A x (t f } + v(t f ) = 0 
(t f ) + X ( t f ) = 0 


or 


II 


= 0 


The optimum profile 


(2.9) 


Case III: Fixed final volume, free final time - Here the optimal 
profile must satisfy 

*x (t f ) + V f - 0 

v (t f ) - V f = 0 or F 11X = 0 

H (t f ) = 0 (2.10) 

Case IV: Free final volume free final time - Here the optimum 
profile must satisfy 

A x (t f } + V(t f ) = 0 

(t f ) + X(t f ) =0 or F IV = 0 

H (t f ) = 0 (2.11) 

The optimal profile is obtained for each case when the 
respective conditions are satisfied. The optimisation problem is 
a two-point boundary value problem, since the conditions on X,V 
are defined at t=0, while those on the adjoint variables have to 
be satisfied at t = t^. 
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The solution hence has to be obtained iteratively using a 

technique like the Newton Raphson method. Thus for cases I, II we 

iterate on variables X vQ while for cases III, IV we iterate 

on X , X , t ^ . 

XO VO f 

The iterative scheme is 


U n+1 = U? - J . 1 F. 
1 111 


where 


U I 

- U II = 

1 — 1 

X 

0 

X ] 

VO 

U III 

- U IV = 

[X , 

XO 

X , 

VO 
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J T = 


’II 


III 


IV 


ax 

X 

ax 1 

X 

-l 

ax 

xo 

ax 

VO 


av 

av 


ax 

xo 

ax 

VO 


'ax 

X 

t._ 

av 

ax. 

ax 

xo 

ax 

xo 

ax 

ax v 

ax 

ax. 


x 


av 


VO 

V 


ax 


VO 

ax 


ax 


xo 


ax 


xo 


ax 


VO 


ax 


VO 


( 2 . 12 ) 


( 2 . 13 ) 


fax 

X 


ax 

X 

ax 

X 

-l 



ax 

xo 


ax 

VO 

at 




av 


av 

av 




ax 

xo 


ax 

VO 

at 




3H 


3H 

aH 



(2 

ax 

xo 


ax 

VO 

at 



fax 

X 


av 

ax 

x + 

av 

ax 

av 

ax 

xo 

+ 

ax 

xo 

ax 

VO 

ax 

VO 

at 

at 

ax 

V 


ax 

ax 

V 

JL_ 

ax 

ax 

V 

ax 

ax 

xo 

+ 

ax 

xo 

ax 

VO 

ax 

VO 

at 

at 


5H 


3H 


3H 


. 

ax 

xo 

ax 

VO 

at 



( 2 . 15 ) 

In the above scheme the elements of the Jacobian matrix have 
to be evaluated at the terminal stage i.e. final time. The 
solution technique hence relies on the accurate evaluation of 
these derivatives. The equations which govern the evolution of 
these derivatives are given in Appendix I & II. 
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2.3 Results and Discussion 

The method of solution discussed above was used to obtain the 
performance of the fed batch reactor for all the four cases . The 
kinetic parameter chosen for all the computations reported in this 
work are 4 =5.2 hr" 1 , a = 1.0, |3 = 25.0, y = 62.9 . 

The other parameters chosen for optimisation are V q = 7.0 1, 
S q = 0.143 10 -3 g/1 , X q = 0 . 1 , S f = 500, V f = 10 1, t f = 10 hr, p 
= 4.0 for case I. The corresponding optimal flow rate profile is 
shown in Fig. 2.1. The biomass (X f V f ) at the end of cycle is 
1.243 0. The biomass obtained when the substrate is added at an 
average flow rate F = 0.3 is X^V^ = 1.2259. The biomass while 
operated in the batch mode i.e., all the substrate is added 
initially to the reactor is 0.9416. For this case I, there is an 
improvement of 1.375% and 24.25% respectively over fed batch 
operation with a constant flow rate and batch operation. 

The effect of the parameter p on the optimal feed rate policy 
is depicted in Fig. 2.2. For high values of p, the deviation from 
the average flow rate has to be minimised and so the optimal flow 
rate profile is as close to F as possible. This yields = 
1.2430. When we decrease the parameter 'p' the optimal profile 
exhibits a significant deviation from F. Now the weightage of the 
cost effect of the deviation from F has been decreased. So the 
optimal flow rate profile can deviate from F and there is a 
substantial improvement in the total amount of biomass produced 
(For p = 0.8, X f V f = 1.4081). 

The results for the other four cases of operation are 
summarised in Table 2.1. In this table we have used the same 
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weighting factor, 'p' for all four cases. The improvement in 
biomass produced for case IV is 50.76% and 15.31% over batch and a 
fed batch operation with a constant flow rate. This is the total 
optimisation problem, since here we constrain neither the final 
time nor the final volume. The improvements in reactor 

performance for cases II, III where we constrain either the final 
time or the final volume lie in between the case I (where both are 
constrained) and case IV (with no constraints) . 

As discussed earlier, the improvement in reactor performance 
as measured by the amount of biomass produced at the end of the 
cycle is more pronounced as we decrease p. However, as we 
decrease p, the problem becomes singular and the convergence of 
the numerical scheme is not ensured. The effect of p on the 
optimal performance can be seen by comparing the results presented 
in Table 2.2 and Table 2.1. As p is decreased the total biomass 
produced at the end of the reactor cycle increases for each case. 

The corresponding optimal flow-rate profile for each of these 
cases is depicted in Fig 2.3 (a-d). The values of the parameter 
'p' for which the simulations were performed are also indicated. 

In this mode of operation the optimal profile is dependent on 

the initial conditions. The kinetic expression is characterised 

★ 

by the substrate concentration S at which the reaction rate is a 

maximum. Two other characteristic quantities quantifying 

substrate concentration are S q , the initial concentration and S f , 

the feed concentration. Cazzador determined the effect of 

initial conditions on the optimal flow rate profile. We now 

★ 

discuss this effect for, different orderings of S Q , S , S f . 
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* 

S < Sp < S Q — The optimal flow rate profile for this case 

is shown in Fig. 2.4a. The flow rate decreases with time. The 

initial substrate concentration is very large here. The reaction 

rate at this S is low. Starting with a high ' F ' we reduce the 

★ 

substrate concentration from S to S . This increases the 

o 

reaction rate and results in an optimal performance. 

S < S Q < Sp — Here the optimal flow rate profile increase 

with time (Fig. 2.4b) . The reaction rate at S q is lower than the 

maximum. Addition of substrate at S p would servee to only 

increase S and thereby decrease the reaction rate further. The 

addition of the substrate hence has to be initially low as the 

addition of high F(t) initially would increase S Q to a value away 
★ 

from S thereby lowering the reaction rate. 

'k 

S q < S < Sp — Here again the flow rate profile decreases 

with time. The addition of a significant amount of substrate 

★ 

(high S„) initially increases S close to S and this increases 

r O 

the reaction rate. As time progresses the flow rate is decreased 

★ 

so as to maintain Sp close S (Fig. 2.4c) 

S q < S < Sp — Here when S p is significantly high, the flow 

★ 

rate is initially high. This raises S Q to S . The flow-rate is 

★ 

then decreased to prevent S_ from increasing beyond S which would 

r 

decrease the reaction rate. The gradual increase in the flow rate 
in the second half ensures that the substrate concentration is 
around S (Fig. 2.4d) . 

S < S* < S — Here the initial concentration is high so the 
F o 

reaction rate is low. A significant amount of S p is added 

★ 

initially thereby reducing S Q to close to S . This generates the 
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decreasing profile of F(t) (Fig. 2.4e). 

★ 

S o < Sp < S — Here S Q is low and by adding S p at a high 

"if 

flow rate we increase S Q closer to S thereby increasing the 
reaction rate. The flow rate then decreases with time (Fig. 
2 . 4f ) . 

'k 

S„ < S < S — Here the initial concentration is lower than 
F o 

★ 

S . The optimal feed rate profile increases with time. Here 

★ 

initial concentration is closer to S than Sp. Adding a high 
amount of fresh feed would only lower S q and the reaction rate. 
So it is necessary to start with a low flow rate. The flow rate 
increases with time and thereby filling up the reactor (Fig. 
2.4g) . 

The quantitative results of a typical set of calculations ,is 
tabulated in Table 2.3. Simulations were performed for other 
cases to study the effect of initial conditions. These also show 
a similar trend. 

In most cases the biomass increases monotonically with time. 
For some cases there is an increase followed by a decrease and for 
some there is a decrease followed by an increase, under optimal 
conditions. A typical variation of the biomass concentration with 
time is shown in Fig. 2.5. 

2.4 Conclusions 

In this work we have obtained optimal flow-rate profiles for 
a singular problem by converting it to a non-singular problem. 
This is achieved by modifying the objective function. 

As we decrease the parameter, p, the importance on the 
variation of F is reduced. Here a more significant variation in F 
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is permissible and there is a significant improvement in biomass 
produced. The convergence of the numerical scheme is ensured for 
large values of p . As we lower the parameter p however, the 
optimisation program approaches the singular limit. For low p, 
the optimisation program does not converge easily. The cut off 
value of p, above which convergence occurs depends on the case 
being studied. 

This cut off value is low for case I and high for case IV. 
This is to be expected as case IV is the compeltely optimal 
problem. Here are no constraints on or t ^ . 

The optimal profile generated exhibit a continuous variation 

t 

in F ( t ) . This is to be expected as now we have a non-singular 

problem. The optimal profiles generated can be used to obtain 

qualitative insight into the sequence of control actions of the 

singular problem. Thus for the case represented in Fig. 2.3a, the 

optimal profile for the singular problem (with p =' 0) would 

consist of a time interval where F(t) is F , followed by a 

m.ci,x 

period where it is F . . This in its turn would then be followed 

r mxn 

by a singular arc. 

The technique proposed in this work can be used to obtain 
qualitative insight into the diffierent sequences of control 
actions for the singular problem. The techniques proposed by 
Modak 11 can then be used to numerically solve the problem 
elegantly. 
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CHAPTER 3 


On the Bifurcation Features and the Optimal Performance 
of a Repeated Fed-Batch Reactor 


3.1 Introduction 

Biochemical reactions are characterised frequently by 

substrate inhibition. Reactors sustaining such reactions exhibit 

an optimal performance when operated in a fed-batch mode . Here 

the substrate is usually added to the reactor over a period of 
4 12 

time (Cazzador , San and Stephanopolous ) . These works deal with 

the performance of non-repeated fed-batch reactors . 

The control variable i.e., substrate feed rate occurs 

linearly in the problem. The optimal control profile is hence 

15 

bang-bang and/or consists of a singular arc. Weigand has 

analysed the performance of reactors operated in a repeated fed 
batch mode. He analytically established that the optimal reactor 
operation was obtained when the flow rate was first at its upper 
bound, F max ' then followed by a singular arc, and finally a 
segment when F(t) was at its lower bound, F m j_ n / (usually zero). 

The non-repeated fed-batch mode of operation is similar to 
the operation of the batch reactor as the initial conditions 

influence the system performance. For the repeated fed-batch mode 
of operation the initial conditions determine the terminal state 
only when multiple co-existing states exist in the system. Here 
the terminal state i.e. the system state after a large number of 
cycles is a periodic state. This is similar to the steady- state 
of a continuously stirred tank reactor (CSTR) . 
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In many systems however, it is not possible to obtain optimal 
profiles analytically. The numerical computation of the optimal 
profile needs insight into the interaction between the different 
variables. This allows us to determine qualitatively the sequence 
of control variable profiles, which have to be maintained. A bad 
choice of the sequence may result in non- convergence of the 
numerical scheme for problems singular in the control variable 
(Modak) 11 . 

In this work we establish that the biomass concentration and 
the substrate satisfy the stoichiometric relationship in the 
terminal state of the repeated fed-batch operation. We also 
discuss how the bifurcation features of the repeated fed-batch 
reactor when filled instantaneously are similar to that of a CSTR. 

We also consider the optimal operation of the repeated 
fed-batch reactor. The objective function is modified to include 
the cost associated with preferring the optimal profile over a 
constant feed-rate. This is assumed to be proportional to the 
square of the deviation variable. The problem is now rendered 
non-singular and can be solved elegantly using Pontryagin's 
maximum principle. We show how decreasing the effect of the 
weightage on the cost factor, allows us to approach the limit of 
the classical singular problem. This technique can be used to 
determine the sequence of i.e., ordering of the control actions 
for the classical singular problem. This is especially useful in 
systems where it is not possible to elegantly obtain analytical 
solutions and the physical interaction of the variables is 
complex. The numerical technique proposed by Modak 11 can then be 
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implemented elegantly to compute the quantitative profile for the 
singular problem. 


3.2 Mathematical model 


In this work the evolution equations of biomass, X, and 
substrate concentration, S are assumed to be given by 

(XV) = Xjn(S)V 3.1(a) 


(SV) = -X H + FS p 


3.1 (b) 
3 .1 (c) 


V = F 

The reactor is operated cyclically over a fixed time t^. 
Over this period the volume increases from V q to V^ i.e., 


V(t ) = V 3 .2 (a) 

o o 

V(t f ) = V f 3 .2 (b) 

At the end of the cycle the reactor contents are partially 

removed to reduce V- to V . This reduces the volume of the 

f o 

reactor. The concentration at the beginning and at the end of 
cycle are however equal. So the terminal state satisfies 


X(t ) = X(t f ) 3 .3 (a) 

S (t ) = S (t -) 3 .3 (b) 

o r 

In the repeated fed-batch mode of operation we are not 
interested in the transient behaviour of the system. This can be 
obtained from a dynamic simulation. The terminal state i.e., 
after the initial transients have decayed is of importance. This 
is a periodic state as the state variables satisfy 3(a,b) . This 
arises due to the periodic forcing imposed by the periodic 
variation in the substrate feed-rate. This periodic state is 
analogous to the steady- state behaviour of the CSTR. 
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3.3 Relationship between, X,S in the terminal state 

We now establish that the biomass concentration X, and the 
substrate concentration S, satisfy the stoichiometric relationship 
at all instants of time. From the equations (3.1a,c), we obtain 


+ (sv) - (VS p ) 


0 


!3.4) 


or 


X(t ) 

— + S( V 


V = 
o 


X(t f ) N 

— - + - s p v £ 


(3.5) 


This relationship must be satisfied for each cycle. Thus we 
have, for the ith cycle 


r x(t,) 

> 


X ( t ) Y 

V 

O 


( Y + s(t f> 

- S p 

i 

Y + S(t c> ‘ S F 

• v7 

i f 

(3.6) 


Since the concentrations at the end of the ith cycle, are 

fclr 

same as the concentrations at the beginning of the (i+1) cycle, 
we have 


X(t ) , 


( x( v 

> 

V 


— + S(t ) - S F 

i+1 

( Y - S(t o> 

S F 

J 

CJ 

• vl 

i f 

3.7(a) 


This recursive relationship can be used to obtain 


' x(t „> 

— + S(t o ) 


I.' 


/- X(t. 


— + S(t o } " S F 


\ /- V q >n-l 


^ V f 


+ S, 


For n 


00 


• (■ 


V ^ n-1 
o 


V, 


V 


3 .7 (b) 


0 as 


V, 


< 1 and we have at the 


terminal state (after a sufficient number of cycles) 


x <t> 

— + S(t o> 


1 - 


Clearly from this it follows, at every time instant 
X(t) 


S(t) = S T 


g(x) 


(3.8) 


(3.9) 


'F Y 

The biomass and substrate satisfy the stoichiometric 
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relationship (3.9) at all instants of time. 

This can be used to reduce the three dimensional system 
(la-c) to the two dimensional system 

X = X*x(g(X) ) - ^ 3.10 (a) 

V = F 3 .10 (b) 

The rate dependency on the substrate throughout this work is 
assumed to be of the Haldane form 


H(S) 


p s 

max 


aS + /3S + y 


(3.11) 


3.4 The Rapid Fill Case 

The repeated fed-batch operation can be carried out by a 
filling the reactor from V q to instantaneously at the beginning 
of every cycle . In this mode the reaction is carried out in a 
batch mode for t~. Thus the evolution is governed by 

X = u(S F - |) X 3.12 (a) 


However, now the concentration at the beginning of a cycle after 
the pulse is added i.e. at t^ is different from that at the end of 
the previous cycle i.e. at t~. From the mass balance we have 

Vf X(t+) - v o x <t') 


or 


X(t + ) = r X(t.) 3.12 (b) 

o t 

Here, r, represents the draw down ratio Vq/V^ . The biomass 
concentration now exhibits discontinuities at the end of every 
period. The dimensionless concentration of biomass u = (X/YS p ) at 
the end of the cyclic state tj is given by integrating (3.12a) 

dX = t (3.13) 

ru Xp. (Sp- y) 

Integrating the expression on the left we have 
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t f «< s F > 


= (aSp + jSSp + r) ” 1 ^aSp (In (1/r) -u + ur) 
+ (3S p In (l/r) + K In (l/r) - y In 


(3.14) 


3.5 Formulation of Optimal Control Problem 

Our objective in the study of the optimal control problem is 
to 

Minimize J = -X- ( t _) (V ( t € ) - V ) + p f f (F(t)-F) 2 dt (3.15) 

F (t ) r r r o J Q 

'The first term of the right hand side is representative of the 

increase of the total biomass in the reactor over a cycle while 

the second represents the cost in preferring the optimal profile 

over the average F . 

The optimal control problem is solved elegantly by using 

Pontryagin' s continuous maximum principle. A detailed discussion 

( 3 ) 

of this can be found in Bryson and Ho . The introduction of the 

quadratic term renders the problem non- singular . We construct the 

Hamiltonian 

+ A v F + p (F-F) 2 (3.16) 

Here the evolution of the adjoint variables X , X is 

-X. V 

governed by 

A x = " A x + X - I] 3.17(a) 


H = A 


x 


X*i(g(X) ) 


FX 

V 



The optimal profile F(t) 
yields 


is obtained by setting H p 


3.17 (b) 
0 . This 


F 





(3.18) 
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In this work we study two cases of repeated fed-batch 
operation (I) fixed final volume, fixed final time (II) free final 
volume, fixed final time. In the latter mode we optimise reactor 
performance with respect to the draw-down ratio as well . 

Each of the above problems is a two point boundary-value 
problem as some of the variables are specified at t , and others 
at t f . This has to be solved using an iterative scheme like the 
shooting method. The three variables to be determined are [A , 
X(t Q )]. These are represented vectorically as w. The 
iterative scheme for the ith case is given by 


n+1 

r 

1 



F. 

1 


where 
for Case I 


A (t-) + 

x f 

1 

44 

> 

V 

= 0 


v( tf) - (V f ) 

= 0 


H 

II 

X (t f ) - X(t o ) 

= 0 




ax 

X 


ax 

x 

ax ] 


ax 

xo 


ax 

VO 

ax 

o 

1! 

H 

*"3 

av 


av 

av 

ax 

xo 


ax 

VO 

ax 

o 


ax 


ax 



ax 

xo 


ax 

VO 

ax 1 

o J 


for 

Case 

II 


X 

X 

(t f ) 

+ (V(t f ) - V Q ) =0 


X v 

(t f ) 

+ x(t f ) = 0 

F II - 0 

X 

(t f ) 

- X(t o ) = 0 



(3.19) 


3 .20 (a) 


3.20 (b) 


(3.21) 
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II 


ax 


xo 


dX 


vo 


ax 


n -1 


u A. 

X 

t. 

av 

U/l 

X 

av 

U A. 

X 

av 

ax 

xo 

ax 

xo 

ax 

VO 

ax 

VO 

ax 1 

o 

ax 

o 

ax 

V 

ax 

ax 

V 

? 

ax 

ax 

V 

1 

ax 

ax + 

xo 

ax 

xo 

ax 

VO 

ax 

VO 

SX o 

dX 

o 

ax 


ax 


ax 

- i 


(3.22) 

3.6 Results and Discussion 

The repeated fed-batch operation of a reactor is the 
periodically forced operation of a reactor. Here a substrate feed 
rate profile is maintained over a cycle. The reaction is 
partially emptied from the final volume to the initial volume at 
the end of the cycle and the operation is repeated. The biomass 
and substrate hence exhibits a periodic behaviour with time. This 
periodic forcing renders the system non- autonomous . This is not 
immediately obvious from the equations (3.1a-c) whose right hand 
side are not dependent explicitly on time. 

The repeated fed-batch is a periodically forced operation of 
a batch reactor. This mode of operation is similar to the 
continuous operation of a CSTR. In the CSTR the basic state of 
operation is the steady-state. Here the dependent variables X, S 
are independent of time. The concentrations in the fed batch 
reactor however, vary cyclically. In particular the concentration 
at the end of a cycle is identical to that at the beginning 
provided the flow-rate F(t) is finite for all times (see 3.3 (a, b), 


3.12 (b) ) . 

A possible mode of operation of the repeated fed-batch 



reactor as discussed earlier is when the substrate is added 

instantaneously to the reactor at the beginning of the cycle . The 

reaction is then allowed to proceed in the batch mode. In this 

mode of operation the concentration of dimensionless biomass, 
* 

X (X/YSp) at the end of the cycle is given by the roots u of 

* 

equation (3.14). In Fig. 3.1a,b we depict the variation of X on 

* 

dimensionless dilution rate D . This latter quantity is defined 

for the fed-batch reactor as (l-r)/(t^ fi(S p )). This figure is 

called the bifurcation diagram of the system. The dependence of 
★ ★ 

X on D of the fed-batch reactor is compared with that of the 

* 

CSTR. Fig. 3.1a exhibits the variation for S > Sp, and Fig. 3.1b 
★ ★ 

for S < S_. Here S represents the substrate concentration at 

r 

which jLi(S) = 0, i.e. the rate is a maximum. Throughout this 
work we have assumed the kinetic parameters to be h max = 5.2, a = 
1.0, /3 = 25.0, y - 62.9. For this choice S = VTJoc = 7.9. 

The bifurcation diagram for the CSTR is obtained by the 
solution to 

D* = 4(S p (l-X*) ) /4(Sp) (3.23) 

The bifurcation diagram is characterised by a region where 

* 

bending back occurs for S < S p for fed-batch mode of reactor 

operation. This is well established for the CSTR (Bailey and 

Ollis) . For the fed-batch operation the condition for the 

dt^ 

bifurcation diagram to bend back is obtained by setting = 0 in 

(3.14). 

In order for the bifurcation diagram to possess a nose i.e. 
to turn back we further set u=0 and solve for S p . This yields 
the relation . 
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(r-1) 


(aS p + (3S p + y) 


[aS p - y] - 0 


(3.24: 


From this we obtain S„ = S = v r/a, for the bifurcation diagram to 


just start bending back. 


Thus the same criterion on S, 


distinguishes the two bifurcation diagrams for the fed-batch 
reactor as for the CSTR. 

It is tempting to interpret the equation (3.13) as predicting 

wash out to occur at an infinite dilution rate. Clearly the 

bifurcation diagrams (Fig. 3.1) indicates washout beyond a finite 

dilution rate. This indicates that the trivial state (of washout) 

occurs for all dilution rate. This can be seen by examining that 

the trivial state with X (t*) = 0 satisfies the ordinary- 

differential equation and associated boundary conditions (3.'la-c, 

/ 

3.12a-b) for all t^s. 

The point at which the non-trivial branch emerges from the 
trivial branch can be obtained by investigating the 
linear-stability of the basic "wash out" periodic state. This can 

g 

be done using Floquet theory (Ince) . The stability of the 
trivial steady- state is obtained by studying the evolution of 
This is governed for the rapid fill case by 


ax 


ax(t Q ) 


d_ 

dt 


ff-1 - <M(g<x>> + x 3 " ( f| x> ) ) ||- , 3.25(a) 

^ n' J n 


- 1 


sub j ect to j 

where = "SUt-t: 


3.25 (b) 
3.25 (c) 


At the wash out state we have X = 0 . This yields 
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ax ) , . ax 

ax I ^ b F' ax 

O j O 


3.26 (a) 


with 


3.26 (b) 


o' t=t 


Solving this we obtain 


= r e 


h(S p ) t f 


3.26 (c) 


o' t=t. 


The washout state is stable when the Floquet multiplier lies 
within the unit circle, i.e. 

1 rax 'I I u(S )t f 

<1. This yields re < 1 . In terms of the 


o' t=t. 


dimensionless dilution rate, D 


V.- V 
f o 

V f t f H(S F ) 


stability condition yields D cr = (r-l)/ln(r) 


(1-r) 
t f /i (S p ) 


This critical 


dilution rate is always less than 1 for 0 < r < 1 . Hence wash out 

occurs earlier in the repeated fed-batch mode than in the CSTR. 

* 

For the case S^ > S , it must be emphasised that the portion 

r 

of the curve in the positive slope region is unstable in Fig. 3.1. 
In the mode of rapid fill operation of the repeated fed-batch the 
biomass concentrations are discontinuous at the beginning of each 
cycle (Fig. 3. 2). We have depicted the variation of the biomass 
with time in Fig. 3.3 for this case. 

In Figure 3.4, 3.5 we have depicted the bifurcation diagrams 

for the repeated fed-batch mode of operation when the flow-rate is 

? 

a constant, F, over the entire cycle. In this diagram the 
draw-down ratio is a constant. Consequently as we change t f , to 
ensure a constant V /V f , we change the average value of F, to 


generate the diagrams . 
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Once again the trivial solution exists for all 't^' as 
discussed earlier. The bifurcation of the non-trivial solution 
from the trivial state occurs where the trivial solution loses its 
stability. This can be found from Floquet theory by integrating 


ax ] 

r 

ax , 

o J 



4(X) + X 


dfJL(X) 

ax 


F ' 
V 


ax 

ax 


3.27 (a) 


subject to 


ax 

ax 


= 1 


t=o 


At the trivial state X = 0, and the equation becomes 


ax ] 

/ 

ax 

o ) 

l 


4(S p ) - 


V + Ft' 
o 


Integrating this we have 


ax 

ax 


ax 

ax 


t=t , 


3.27 (b) 


V Q 4 (S) t f 


Hence the bifurcation point in terms of the dimensionless 
residence time is again D cr = (r-l)/ln(r) . Again two different 
bifurcation diagrams are possible. This depends upon the Sp 
value. These are depicted in Fig. 3.4 and 3.5. 

The operation of the repeated fed-batch mode, with the 
instantaneous feeding and the constant flow- rate F are known to be 
suboptimal . 

We now discuss the optimal performance of the repeated 
fed-batch reactor. 

Case - I: In this case we consider the entire cycle time and the 
draw down ratio V Q / V f to externally fixed. This is solved by 
integrating equations 3.10a,b, 3.17a,b. The optimal profile is 
obtained when equations 3.20a are satisfied. This is ensured by 
iterating on w^ using 3.19. 

The optimal flow-rate profiles for different values of p, are 
depicted in Fig. 3.6. For high values of p the optimal profile of 
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flow-rate is very close to the average flow-rate F. This is only 
to be expected as now the weightage on the cost factor is high and 
the system tends to optimise the performance by minimising the 
cost rather than by maximising the productivity. As we decrease, 
p, it is seen that a larger variation in the flow-rate is 
permissible i.e. the deviation from the average flow-rate profile 
is high. This leads to a very significant improvement in the 
system performance i.e. biomass production. Here the system 

tends to optimise by improving the biomass production rather than 
by minimising the cost. A typical variation of the biomass 
concentration over a cycle is shown in Fig. 3.7. Since the 
imposed flow rate is bounded this variation is continuous. In 
particular the biomass at the end of the cycle and at the 
' beginning are equal as opposed to the case of the intancaneous 
feed. This plot is for p = 1.0. 

In Table 3.1 we compare the performances of the optimal 
profile with that of the fed-batch reactor filled at an average 
flow-rate F, and the rapid fill fed-batch where the substrate is 
added instantaneously at the beginning of the cycle. The 
performance of the rapid fill case is the best and that with the 
average flow-rate F is very close to the optimal performance. 
This is the situation since the feed concentration here is lower 

“ic 

than S .Since in this case the final volume and time are fixed the 
performance of reactors with F, and instantaneous feed do not 
change, as they are independent of p. 

The singular optimal control problem of repeated fed-batch 
mode of operation was investigated by Weigand 15 . The optimal 
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profile consisted of an instantaneous pulse feed, followed by a 
singular arc and then by a batch period. However, this is the 

Jc k 

optimal profile when S p > S . The optimal profile for S p < S 
corresponds to the instantaneous filling of the reactor. 

To study the effect of the parameter S„ on the optimal 

r 

profile of our problem we simulated the optimisation for = 

r 

14.75 > S* (7.9). The optimal profile (Fig. 3.8) is of 

qualitatively different form. It consists of a portion where the 

flow-rate is almost a constant and greater than F, followed by a 

period of batch operation. This is similar to the results of 
15 

Weigand . The flow-rate does not start of at an infinitely high 
value since we have a non- singular problem and also because we 
want to minimise the deviation from F. The corresponding 
variation of biomass concentration is shown in Fig. 3.9. 

k 

This is in contrast to the optimal profile for S p < S . Here 
the optimal profile is decreasing, and in the singular limit tends 
to the operation of rapid fill, repeated fed-batch reactor. In 
this mode the concentrations of substrate over a cycle is always 

k 

less than S . Consequently the reaction behaves like ic is 
governed by Monod kinetics (with monotonic dependency on S) . The 
optimal operation hence is the instantaneous fill for this case. 

The non- singular problem discussed here hence provides 
insight into the sequence of control actions of the classical 
singular problem as the parameter p tends to zero. Thus the 
profiles generated using our technique especially for low, p can 
be used to obtain insight into the different sequences of 
flow-rate profiles for the classical singular problem. This will 
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reduce the numerical scheme to determining only the "switching 
times between the different control actions." 

In Fig. 3.10 we depict the performance of the case where the 
cycle time is fixed but the final volume is not. Here we optimise 
the performance with respect to the draw down ratio as well . 

The optimal profiles exhibit a similar trend i.e. decreasing 
trend as in Fig. 3.6. The optimal profile for the singular 
problem i.e. in the limit p = 0 is hence similar to that discussed 
in Weigand for this case also. 

In Table 3.2 we compare the optimal performance wirh that of 
the reactors with a constant flow rate F and instantaneous feed 
rate for the optimal Vp obtained. The constant flow rate F used 
to compute the optimal profile is 0.3. However, the results 
reported for the case of constant F operation in the Table is such 
that F is the flow-rate which fills the reactor from V to the 
calculated by the optimal profile over the cycle time. Here again 
the improvement in the performance is best for the rapid fill case 
and when we minimise the deviation from an average flcw-rate the 
performance is not very good. In the limit of p tending co zero the 
optimal performance catches up with the instantaenous fill. 

Also for the same p the optimal performance is better when 
the final volume is not fixed in comparison to the case when it is 
fixed. This is only to be expected since we have now optimised 
the performance with respect to the draw-down ratio. 
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3.7 Conclusions 

In this work we have analysed the bifurcation feature of the 

repeated fed-batch reactor operated in sub-optimal modes. The 

reactor shows the same qualitative behaviour as that of a CSTR. 

The critical dilution rate beyond which wash out occurs for 
* 

the CSTR i.e. at D =1. However, for the case of the rapid fill 

mode of operation, and the case where the flow rate is a constant 

*• 

the washout state is unstable for lower values of D . The 

cr 

critical dilution rate is lowered. This value is obtained by 
using Floquet theory on the trivial state as (r-l)/ln(r) . 

We have also obtained the optimal reactor performance for the 
case of a fixed draw-down ratio and the case of an optimal 
draw-down ratio. The performance for the latter case is always 
better than that of the former. The optimal profile obtained 
using the method proposed here for low p, can be used to generate 
an insight into the sequence of operations for the classical 
singular problem. This insight can then be used to numerically 
calculate the optimal profile for the singular problem. 
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Table 2.1 


Comparison of Performance (X f V f ) for Different Cases Batch, 
Semi-Batch (Constant F) and Optimal Fed-batch 


Case 

X = 
o 

0 ' 1 ' S o = 

0 .142857*1. e-3 

, P = 4. 

.0, Sg= 500, 

F = 0.3 

t 

o 

fc f 

V 

o 

V f 

Xf v f 

fed 

batch 

Xf v f 

Semi-batch 
with const 

Xf v f 

batch 

F 

Fixed 

final 

time 

fixed 

final 

volume 

0 

10.0 

7.0 

10 . 0 

1.2430 

1.2259 

0 . 9416 

Fixed 

final 

time 

free 

final 

volume 

0 

10 . 0 

7.0 

9 . 8417 

1.2636 

1.2437 

0 . 9508 

Free 

final 

time 

fixed 

final 

volume 

0 

11.3375 

7.0 

10 . 0 

1.3518 

1.3213 

0 . 9796 

Free 

final 

time 

free 

final 

volume 

0 

32.2009 

7.0 

15 .0809 

2.5171 

2 . 1317 

1 . 2393 
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Table 2.2 


Effect of p on the Biomass Production (X f V f ) in Fed Batch Mode 
Comparison with Semi -Batch (Constant F) and Batch 


Case 

X 

o 

= 0 . 

!, S Q « 0. 

142857 

* l.e-3, 

S f = 500 

, F = 0.3 


P 

t 

o 

fc f 

V 

o 

V f 

XfVf 

fed 

batch 

Xf v f 

Semi-batch 
(const F) 

XfVf 

batch 

Fixed 

final 

time 

fixed 

final 

volume 

0.8 

0 

10 . 0 

7.0 

10 . 0 

1.4081 

1.2259 

0 . 9416 

Fixed 

final 

time 

free 

final 

volume 

2 . 0 

0 

10 . 0 

7.0 

9.5798 

1.3393 

1.2769 

0 . 9686 

Free 

final 

time 

fixed 

final 

volume 

3.0 

0 

12 . 2464 

7.0 

10 . 0 

1.4554 

1.3904 

1.0064 

Free 

final 

time 

free 

final 

volume 

3 . 8 

0 

28.2330 

7 . 0 

13 . 6668 

2 . 5578 

2.0465 

1.2078 
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Table 2.3 


Effect of Initial Conditions on the Flow Rate Profile and Biomass 
Production for Fixed Final Time Fixed Final Volume 


Case 

X Q = 0.1, t f = 10.0, V Q = 7.O., V f = 10.0, 

S* = 7.9310 

P S o S f 

x f v f. 

fed 

batch 




1. 

* 

S 

< 

S F 

< 

s 

o 

0 . 05 

15 . 0 

10 . 0 

2.3140 

2 . 

* 

s 

< 

S 

o 

< 

S F 

0 . 05 

10 . 0 

15 . 0 

2.4454 

3 . 

s 

o 

< 

k 

s 

< 

S F 

0 . 8 

0.142857 
*1 . e-3 

25 . 0 

2.1429 

4 . 

S 

o 

< 

* 

s 

< 

S F 

4 . 0 

0.142857 
*1 . e-3 

500 

1.2430 

5 . 

S F 

< 

* 

s 

< 

S 

o 

0 . 8 

25 . 0 

0 . 142857 
*1 . e-3 

2 . 0394 

6. 

S 

O 

< 

S F 

< 

k 

s 

0.3 

0.142857 
*1 .e-3 

5 . 0 

1.2113 

7 . 

S F 

< 

s 

o 

< 

* 

s 

0.3 

5.0 

0.142857 
*1 . e-3 

2.2492 
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Table 3.1 


Comparison of Biomass Production of the Case Fixed Final Volume, 
Fixed Final Time of Optimal F, Repeated Fed-Batch with Constant F 
and Rapid Fill. 

Fixed time fixed volume 


1! 

0 

X 

1.0, 

O 

CM 

II 

0) 

o 

H 

II 

$ 

v. 

00 

o 

II 

13 = 25.0, y = 62.9, 

V = 
o 

7.0, 

V f = 10.0, 

t f = 10.0, F = 0.3 

' 4 max = 5-2 

p 


w v 

(optimal) 

x f (v f- V 

(const. F) 

W V 

(rapid fill) 

10 . 0 


3 .5856 

3 . 5816 

4 . 0930 

4 . 0 


3 .5916 

3.5816 

4 . 0930 

1.0 


3 .6210 

3 . 5816 

4 . 0930 
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Table 3.2 


Comparison of Biomass Production of the Case Free Final Volume, 
Fixed Final Time of Optimal F, Repeated Fed-Batch with Constant F 
and Rapid Fill. 


Fixed time 

X o = 1 - 0 ' 

V =7.0, 

free volume 

S f = 2.0, Y 

t f = 10.0, F 

=0.8, a = 

= 0.3, u 

max 

1.0, 13 = 25.0, 

= 5.2 

r = 62.9, 

P 

0 

> 

1 

> 

44 

XI 

> 

W V o> 

W v o> 


(optimal) 

(optimal) 

(const. F) 

(rapid fill 

10.0 

3 . 9027 

10.4414 

3 .8985 

4.5294 

4 . 0 

4.2203 

10 . 9859 

4.2098 

4 .9877 

1.0 

4 . 6027 

12 . 6362 

4.5736 

5.7232 
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APPENDIX I 


The equation (2.7) is substituted back in equation 2.3(a), 

2.3(b), 2.5, 2.6(a), 2.6(b). The senstivity is determined with 

respect to A xq , A vq , by differentiating the evoluation equations 

with respect to A , A for cases I & II. This yields 
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APPENDIX II 


The sensitivity equations required for case (3) and (4) 
besides the equation given in Appendix I are : 
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Plot of X vs. time for a. rapid fill RFB for r * 0.7 
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Optimal flow profile (fixed final volume, fixed 

final t isie > . Effect of parameter p for a repeated 
fed-batch biochemical reactor when S_ < S * (see Table 
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Fig. 4.3 Plot of constant flow rate F in each cycle to obtain 


sp 


the set-point X 


8.606 for Kc 
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Fig. 4.4 Plot of X versus cycle time for Kc = 0.5 
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Fig. 4.5 Plot of constant flow rate F in each cycle to obtain 
the set -point x S p= 


8.606 for Kc 


0.5. 



